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ABSTRACT 



The lack of success of Lya searches for high-redshift z > 2 field galaxies may be 
due to extinction by dust, suggesting that surveys based on lines of longer wavelength, 
particularly Ha, may be more effective. To test the dust hypothesis we have undertaken 
deep broad- (K') and narrow-band (5000 km s _1 , A = 2.177 /im) imaging of the field 
towards the quasar PHL957, in an attempt to detect Ha emission from a known 
galaxy of redshift z = 2.313. We cover an area of 4.9 arcmin 2 (0.28ft -2 Mpc 2 ) to 
a 4er limiting narrow-band flux / = 2.7 x 10 -16 erg cm -2 s , a factor of several 
deeper than previously published surveys. We detect the Ha+[N n] emission line in 
this galaxy at the 3.3ct level, inferring a star formation rate of 18ft. -2 Moyr -1 . This 
is a factor only a few times larger than the rate seen in some Sc galaxies today. The 
faint flux level reached in this work demonstrates the promise of narrow-band imaging 
in the near-infrared as a technique for finding normal galaxies at high redshifts. 
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1 INTRODUCTION 

Blank-sky searches for high-redshift field galaxies (z > 2) 
through the detection of the Lya emission line (de Propris 
et al. 1993; Thompson et al. 1993) have so far had no suc- 
cess. These surveys span the redshift range 2 < z < 5, where 
galaxies may be experiencing their peak star formation rate 
(SFR), and now cover sufficiently large areas and reach such 
f aint flux limits that they are in confli ct with some theories 
(Djorgovski, Thompson & Smith 1993). Two competing ex- 
planations for the lack of success are (i) galaxies formed 
at higher redshift still (but note the unsuccessful search of 
Parkes, Collins & Joseph 1994), or (ii) the Lya emission 
is severely attenuated due to extinction by dust, possibly 
exacerbated by resonant scattering from H i (Chariot & 
Fall 1991; Valls-Gabaud 1993). Surveys based on the detec- 
tion of lines at longer wavelengths, especially [O n] A3727, 
H/3 A4861, [O in] A5007, and Ha A6563, benefit from greatly 
reduced extinction, allowing a test of the dust extinction hy- 
pothesis. The Ha line, which lies in the Tf-band at redshifts 
2.08 < z < 2.66, is particul arly useful becau se it provides a 
direct estimate of the SFR ( Kennicutt 1993]). 

Thompson, Djorgovski fc Beckwith ( J1994 ) have un- 
dertaken a pilot project for a near-infrared narrow-band 
imaging survey. They used a bandwidth of 4000 km s , 



* Based on observations collected at the European Southern Ob- 
servatory, La Silla, Chile 



and their deepest fields reach 4cr detection limits in the 
range 1 — 3 x 10 -15 erg cm -2 s -1 , over a total area of 
0.3 arcmin 2 . Here we report the results of a similar pilot 
project, using a filter of width 5000 km s , which reaches 
much greater depth, 2.7 x 10 -16 erg cm -2 s -1 (4a), and 
covers a considerably larger area, 4.9 arcmin 2 . We have 
targeted the field of the quasar PHL957 (RA l h 00 m 33.4 s , 
Dec - 13°00'11", 1950.0), z cm = 2.681. Our aim was to de- 
tect Ha emission from the known high-redshift galaxy in 
this field, z em = 2.313, hereafter referred to as CI, which 



was found by Lowenthal et al. (1991). This galaxy lies at 



the same redshift as a damped Lya absorption line seen in 
the spectrum of the quasar, and in fact was discovered in 
a narrow-band Lya search for companions of damped sys- 
tems. This field therefore is particularly interesting as it may 
contain other detectable companions of these two objects. 



2 OBSERVATIONS 

Our broad- and narrow-band images of the field were ob- 
tained with the IRAC2B instrument on the 2.2-m telescope 
at the European Southern Observatory, over the three nights 
from 1993 October 31 to November 2. Conditions were pho- 
tometric, and the seeing ranged between 0.7 and 1.2 arcsec. 
The detector for IRAC2B is a NICMOS3 256 2 array. The 
pixel scale of 0.52 arcsec pixel - undersampled the seeing 
in the best conditions, but gave a large field of view, corre- 
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sponding to 0.5 h 1 Mpc [j] comoving at the redshift of the 
galaxy CI. 

The narrow-band filter used, ESO NB9, has a FWHM 
AAna = 0.038 /im, and a central wavelength A c ff = 
2.177 /Urn, which closely matches the wavelength of Ha for 
the galaxy. We used the ESO K' filter for the broad-band ob- 
servations. This filter is slightly narrower, AAbr = 0.32 /im, 
than the standard K filter, and shifted to a shorter wave- 
length, A c ff = 2.15 fan, thereby reducing the sky/telescope 
thermal background by some 0.5 mag arcsec -2 . The obser- 
vations comprised several sequences of duration 45 min, each 
made up of 9 individual 300-s frames, performed in a 3 x 3 
grid pattern of step size 10 arcsec. Each 300-s frame was 
made up of a number of co-added exposures. The integra- 
tion times of the individual exposures were 50 or 100-s for 
the narrow-band, and 10-s for the broad-band, and were cho- 
sen such that the sky counts ensured the observations were 
background limited, while staying well below the saturation 
count level. Total integration times were 405 min for the 
narrow-band, and 180 min for the broad-band. The average 
sky brightness was m na = 12.7, mt>r = 13.1 mag arcsec -2 . 

From observations of standard stars we computed ex- 
tinction and colour terms for both filters. All magnitudes 
quoted in this paper are in the natural system of the filters, 
zero-pointed to K, i.e. for a star of zero colour (J — K = 0) 
?rina = rrihr = K. For the colour range of the standards used, 
0.0 < J — K < 0.4, the following equations apply: 

m na = K + 0.07(J-K), (1) 

m br = K + 0.13(J - K). (2) 

3 DATA REDUCTION 

A dark frame of the appropriate integration time was sub- 
tracted from each data frame. The subsequent stages in the 
data reduction are division by flat field, and sky subtraction. 
The number of detected photons in an individual pixel is a 
sum of contributions from objects (O), the sky (5), and a 
thermal background (T) from the telescope and instrument. 
Before deciding on a method of data reduction it is impor- 
tant to investigate the nature of the spatial and temporal 
variations of S and T. To do this we first formed dome flats 
by creating normalized frames from the difference of expo- 
sures of the dome spot with and without illumination by a 
flat-field lamp. Since T is present in both frames it is re- 
moved in the subtraction, and the flat field created in this 
way should be about as good as a dome flat at optical wave- 
lengths, i.e. an accuracy of a few per cent on large scales, 
and better on small scales. For large scales this was con- 
firmed by an analysis of frames containing standard stars 
placed at different positions within the frame. The counts 
of the stars in the flattened frames show an rms variation of 
2-3 per cent. 

The data frames divided by dome flats show strong gra- 
dients across each frame, of magnitude typically 25 per cent 
of the mean count in the frame, which may be imputed to the 

t We assume a cosmology with h = H o /100 km s — 1 Mpc -1 , and 
q = 0.5 unless otherwise stated. 



thermal background. A comparison of frames taken at dif- 
ferent times in the night shows that this background varies 
little with time, or with mean count level. For example the 
difference of two flattened frames taken 55 min apart, during 
which time the mean count level varied by 15 per cent, shows 
an rms variation of 0.3 per cent of the original mean count 
level. (This also provides an estimate the accuracy of the 
dome flat, i.e. better than 0.3/15 or 2 per cent.) We conclude 
that the background in our frames is characterized by two 
terms: (i) the night sky, which to first order is spatially flat, 
but temporally variable, at the level of a few per cent from 
frame to frame, and 20 per cent over the night, and (ii) the 
thermal radiation from the telescope and instrument, which 
to first order is temporally constant, but spatially variable, 
at the level of 25 per cent across the frame, and 1 per cent on 
the scale of a few pixels. There are additional contributions 
to the background, at the level of a few tenths of a per cent, 
in the form of arc-shaped and v-shaped patterns whose ori- 
gin is unknown. These patterns are particularly pernicious 
because they exhibit both spatial and temporal variations. 
Fortunately, however, they vary smoothly both in position, 
on the scale of a few pixels, and in time, on the scale of a 
few frames. 

It is common practice to use the frames themselves to 
flat-field infrared data. Since our data contain large gradi- 
ents, this procedure would introduce systematic photomet- 
ric errors equal to the magnitude of the gradients. Indeed, 
this was confirmed by an analysis of frames containing stan- 
dard stars, flattened using data frames. The scatter in the 
standard-star photometry was considerably larger than that 
achieved with dome flats. For this reason we used dome flats 
for first-order flat fielding. Because the dome flats are ac- 
curate to a few per cent, which is the desired accuracy of 
the final photometry, it is irrelevant in practice whether the 
subsequent refinements to produce a flat sky background in 
each frame involve only subtraction, as pursued here, or a 
combination of division and subtraction, i.e. first obtaining 
a perfect flat field, followed by sky subtraction. 

The sky, thermal, and pattern contributions were re- 
moved from each flat-fielded data frame in three stages. 
First the large-scale background was removed by subtract- 
ing a heavily median-filtered version (35 x 35 box) of the 
frame itself. The frames were then stacked, and the median 
of the stack was subtracted from each frame. This opera- 
tion removes the average of the flat-field residuals as well as 
small-scale variations in the thermal background, due, for 
example, to dust on the dewar window. Finally a filtered 
version of the data cube was subtracted, using a 5 x 5 x 5 
box. This process removes the patterns, as well as any re- 
maining background (thermal, or flat-field residuals) that 
varies slowly with time. The dimensions of the filter were 
the subject of experimentation to optimize the final results, 
as quantified by the noise in the final combined frames, as 
well as the agreement of the photometry between images 
obtained on different nights. We found that a cubic box 
produced better results than a one-dimensional box (e.g. 
1x1x9). This is because the x, y dimensions are similar to 
the scale of the patterns, and (presumably) because the ratio 
of the dome flat and the true flat field is smooth over these 
scales. Roughly speaking, the accuracy of the flat-field and 
sky subtraction processing is the product of the small-scale 
accuracy of the dome flat (~ 1 per cent per pixel) and the 
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short-term variability of the sky level relative to the long- 
term trend (~ 2 per cent). This product (~ 0.02 per cent 
per pixel) is smaller than the Poisson error for a single frame 
(e.g. ~ 0.1 per cent per pixel for K'). 

A second approach to the flat-fielding and sky subtrac- 
tion used regression fits to the data, and solved, in an itera- 
tive manner, for the three functions, vis the flat field F(x, y), 
the thermal contribution T(x, y), and the sky level S(t). This 
approach produced very similar results. 

The reduced frames were registered, scaled (to account 
for variations in the airmass), and then co-added, weight- 
ing by the inverse of the scaled sky variance, while using 
a percentage clipping algorithm to remove any discrepant 
data points, due for example to cosmic-ray strikes. Bad pix- 
els flagged in a mask frame (1 per cent of all pixels) were 
ignored in the co-addition. 

The dithering employed means that the edge regions of 
the mosaicked final images have a greater noise level, since 
fewer data frames contribute than in the central region of 
common overlap. Therefore we trimmed the mosaicked im- 
ages to the central 256 x 256 pixel region. The noise in the 
sky is uniform over most of this region, but rises slightly to- 
wards the edges. The final broad- and narrow-band images 
are shown in Fig. 1. 



4 RESULTS 

To search for candidate high-redshift galaxies we performed 
aperture photometry, with a radius r — 3 pixels (1.56 arc- 
sec), on all objects visible in the narrow-band frame, and 
selected the 30 objects detected at signal-to-noise ratio > 4 
for subsequent photometry in the broad-band frame. The 
measured magnitudes were converted to approximate total 
magnitudes using an aperture correction measured from the 
brightest objects. It is convenient to scale the frames to the 
same zero-point, such that the relation between total ap- 
parent magnitude m and counts within the aperture C, for 
both frames, is given by 



Table 1. Properties of galaxy CI. 



25 - 2.51og 10 C. 



(3) 



The measured noise in the sky in the central regions 
of the scaled frames is then a na = 8.60 counts pixel -1 , and 
<Tbr = 3.95 counts pixel -1 , which is close to the Poisson 
limit, and corresponds to m na = 22.0 mag arcsec -2 and 
m br = 22.8 mag arcsec -2 . The 4a detection limit is m lla = 
19.3, or a narrow-band flux / = 2.7 x 10 -16 erg cm -2 s -1 . 

The results of the photometry are shown in Fig. 2 which 
plots the m br — irina colour versus narrow-band magnitude 
m na . The typical colour of objects in this plot is mbr- m na ~ 
0.1. This suggests that most of the objects are of rather 
late stellar spectral type, for example cool stars, or elliptical 
galaxies. Objects in the redshift range 2.29 < z < 2.35 with 
strong Ha+[N n] emission lines will lie above the sequence 
of normal objects. The galaxy CI itself lies at the top of Fig. 
2. The measured magnitudes and colour for this galaxy are 
provided in Table 1. The object is detected at 4.5a in the 
narrow-band, but is very faint in the broad-band (1.9cr). 

To select candidate high-redshift galaxies we quantify 
the significance of the excess flux in the narrow-band by 
computing a parameter E, which is the number of standard 
deviations between the counts measured in the broad-band 



Offset rel. to PHL957 

m na 
m br 

m br - m na 
Colour significance S 
EW T {Ha+[N n] 
fua 

SFR g = 0.1 
SFR q Q = 0.5 



42.6"W, 24.1"N 
19.22(4.5cr) 
20.99(1.9o-) 
1.77 
3.3 

> 220 A (2a) 
2.1 ± 0.6 x 10 -16 
36 ± 10/i -2 M yr -1 
18±5h -2 Moyr" 1 



* Offsets computed assuming the frame is oriented N - S. The 
measured position angle in our frames of star A (Fig. 1) relative 
to PHL957 is 187.9°. 



and the number expected on the basis of the narrow-band 
counts. Where an object is extremely faint in the broad- 
band, the error-parameter E is well-defined even in cases 
where the integrated counts within the registered aperture 
are negative, and m br is undefined. In computing E we as- 
sume that only the noise in the sky contributes to the errors. 
For simplicity we suppose zero colour m br = m na , which 
may be approximately correct for the continuum of a high- 
redshift galaxy. Lines of constant E are plotted in Fig. 2. 
The relation between measured colour and E is given by 



m br -m lla = -2.51og 10 [l-E10 



-0.4(25-m na ) 



\Ar 2 (o- 2 a + a 2 r )](4) 



where r is the aperture radius, 3 pixels. 

Because of the small photometric errors at bright mag- 
nitudes, objects with only a small colour excess (either be- 
cause they are red, or because they have lines of small equiv- 
alent width) have large values of E. Therefore we need to im- 
pose an additional criterion of a minimum equivalent width 
for the Ha+[N n] line. Lines of constant rest-frame equiva- 
lent width EW T { are plotted in Fig. 2, computed from the 
relation 



EW lt 



AAbrAAnajl - lQ-°- 4 (™b r -™na)] 

[AAbrlO-O-^br-mna) _ AA na ](l + Z) 



(5) 



For CI we measure E = 3.3, and EW r t = 1190 A, with 
a 2a lower limit EW r f > 220 A, confirming that we have 
detected the Hq+[N ii] line from this galaxy. The measured 
Ha line flux and estimated SFR are provided in Table 1. 
The Ha line flux is calculated from the relation 

_ AA br [l - IQ-O-^br-mna)] ^Q-0.4(m na + 19.57) 

/HQ ~ (AA br - AA na ) L33 (6) 

where the first term corrects for the contribution of the con- 
tinuum to the narrow-band flux, and the second term con- 
verts from magnitude to flux and corrects for the contribu- 
tion of [N n], adopting the medi an rat io of fr$ n]/ fn a = 0.33 
found by Kennicutt and Kent ( 1983] ) for extragalactic H n 
regions. To estim ate the SFR we adopt the prescription of 
Kennicutt fll982|): 



SFR = 



L(Ha) 



1.12 x 10 41 ergs- 



M 



©yr 



(7) 



For z — 2.313 the following relations apply, for different 
values of q . 



SFR = 1.76 x 10 17 / Hq ^" 2 M yr -1 (g = 0.1), 
SFR = 8.56 x 10 16 /h q ^" 2 M yr -1 (g o = 0.5). 



(8) 
(9) 
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Figure 1. Narrow-band (A = 2.177 fim, upper) and broad-band (K 1 , lower) images of the field towards the quasar PHL957. North is 
up and east is to the left. The central 256 X 256 (133 X 133 arcsec 2 ) region of each mosaicked frame is shown. The broad-band frame 
reaches 0.8 mag deeper than the narrow-band frame, but the object CI, a known galaxy at z = 2.313, is brighter in the narrow-band 
frame due to the Hq+[N ii] emission line. 
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Figure 2. Colour- magnitude diagram for the 30 objects detected 
in the narrow-band frame at signal-to-noise ratio > 4. The dot- 
dashed lines are lines of constant £, which is the number of stan- 
dard deviations of the excess flux in the narrow-band relative to 
the broad-band, for an object of zero colour m na = mb r . Also 
shown are lines of constant rest-frame equivalent width, for the 
redshift of CI, z = 2.313. Candidate high-redshift galaxies are 
objects with equivalent widths EW T f > 75 A, and £ > 2. The 
line £ = 2 corresponds to an SFR of llh~ 2 Mq yr -1 . 



In fact the SFR is proportional to the significance E, so 
the lines of constant E in Fig. 2 are lines of constant SFR. 
The line E = 2 corresponds to an SFR = 22h~ 2 M yr" 1 
for q a = 0.1, and to llh~ 2 M yr" 1 for q a = 0.5. 

In addition to CI there are two other objects that lie 
above the lines E = 2 and EW T { = 75 A (although only just), 
i.e. their colours are consistent with their being galaxies at 
the same redshift as CI. The photometry for both objects, 
in both pass-bands, is consistent from night to night. 



cessful detection therefore demonstrates the potential of the 
technique for finding normal galaxies at high redshifts. At a 
colder site and with a larger telescope, such as UKIRT us- 
ing the new IRCAM3 instrument, we would reach a limiting 
flux a factor 2 to 3 fainter with the same integration times. 

We can use our measurements of CI to shed some 
light on the nature of this object, which is a candidate 



primeval galaxy. Lowenthal et al. (1991) measure fhya 



(5.6 ± 0.1) x 10~ ia erg cm"' s" 1 and V = 23.6 for this 
galaxy. For a power-law spectral-energy distribution (SED), 
/„ oc u a , the measured 7\-band continuum flux density cor- 
responds to a = 0.ll2° 6 , where the limits are la. Therefore 
the SED is consistent with the flat SED a ~ expected 
for a young galaxy, but a deeper K' image is needed to 
place better constraints. The measured Ha flux from CI of 
(2.1 ± 0.6) x 10~ 16 erg cm -2 s" 1 provides confirmat ion o f 
the tentative spectroscopic detection by Hu et al. ( 199J ) 



who found (2.7 ± 1.2) x 10" erg cm" s" (where we have 
corrected their flux estimate for the contribution of [N n]). 
Therefore we confirm the conclusion of Hu et al. that extinc- 
tion by dust of the Lya flux from this galaxy is fairly mod- 
est. The ratio fhya/fHa = 2.7 compares with the low-density 
Case B value of 8.3, and implies a reddening E(B— V) = 0.16 
(computed using the extinction law of Seaton 1979). This 
calculation assumes that resonant scatterring does not sig- 
nificantly extend the escape path length of the Lya photons. 
If, on the other hand, resonant scattering is important, the 
Lya line is extinguished selectively relative to the continuum 
and the true rest-frame Lya line EW could be substantially 
larger than the measured value of 140 A. If this were the 
case the object would be classified as an AGN. By measur- 
ing the H/3 line flux the true reddening could be measured, 
and the intrinsic Lya line EW inferred. 

While the Lya line in CI is not greatly affected by dust, 
this may not be true of most galaxies, given the lack of suc- 
cess of Lya searches for field galaxies. Therefore the faint 
flux level reached in the work reported here demonstrates 
the promise of narrow-band imaging in the near-infrared as a 
technique for finding normal galaxies at high redshifts. One 
of the two other possible high-redshift gala xies lies within 
the field surveyed by Lowenthal et al. (1991) for Lya emis- 
sion, but does not show evidence for strong Lya emission. 
Infrared spectroscopy of this candidate and others detected 
in this way will provide a test of the hypothesis that extinc- 
tion by dust is responsible for the lack of success of surveys 
for high-redshift galaxies. 



5 DISCUSSION 

To summarize, we have undertaken a pilot study for 
a narrow-band Ha near-infrared search for high-redshift 
galaxies. We have imaged a single field with an area of 4.9 
arcmin 2 , covering the redshift range 2.29 < z < 2.35. Apply- 
ing selection criteria of EW l{ > 75 A, SFR > ll/i" 2 M Q yr" 1 
there are three objects in the field whose colours are consis- 
tent with their being star-forming galaxies at the targeted 
redshift. One of the objects is a previously known galaxy 
(CI) of redshift z — 2.313, for which we measure an SFR 
= 18/i" 2 Moyr" 1 . (If CI harbours an AGN this is an up- 
per limit to the SFR.) This is a factor of only a few times 
larger than the rate seen in some Sc galaxies today. Our suc- 
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